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ABSTRACT 



This review of evaluations of interactive video 



completed from 1985 to 1989 includes only those evaluations that 
pertain to the instructional use of interactive video, are included 
in a database, and are in the public domain • Exaunmation of 19 
evaluations reveals that many of them were conducted over brief 
amounts of time, and that the programs being evaluated were not 
adequately described • Results on attitude were generally positive, 
whereas results on achievement were mixed. It is easier to achieve 
positive data on attitude since many individuals are impressed by the 
mechanism and characteristics of interactive video equipment. Mixed 
results on achievement can be attributed to the many possible 
variations in the wide range of design characteristics for 
interactive video which render any Kind of general statement about 
achievement invalid. Formative evaluation continues to be an 
important need in the design of interactive video. Finally, 
interactive video allows an individual to select and sequence 
instruction in a way that is meaningful to him or her. Such learning 
is usually non-sequential and non-linear, and requires a fundamental 
change in approach to designing instruction. Information on the 19 
individual reviews is summarized in tabular format. (DB) 
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BELGIUM PAPER 

Last year the community of physicists was presented with the startling news ot the 
production of fusion in a simple apparatus. This discovery offered the promise of the 
solution of the world's energy problem. It was the breakthrough of the century-if not 
the millennium. Within weeks of the announcement of the discovery, it became evident 
that this revolutionary breakthrough may have been a wilNof-the-wisp. 

Perhaps no group should be better prepared to deal with situations such as this 
than educators where breakthroughs come and go with regularity. There is a 
continuing supply of persons who are ready to step forward with a remedy for the ills of 
education. To some extent, it is the overzealous predictions of the proponents which 
stimulate the cynics to voice their recurrent slogan ''it won't work." 

Similar to other innovations, interactive video has been accompanied by many 
claims. Vendors and others who are invested in it, either economically or 
psychologically, have been prone to make assertions about the efficacy of interactive 
video. 

For those who are seriously interested in interactive video, there is a useful body of 
information available in the published evaluation reports on interactive video. These 
reports advance our analysis of interactive video beyond the level anedotes and 
conjecture. 

Five years ago I reviewed all of the evaluations of interactive video I could find 
which met three conditions; 

1. All reports included pertain to instructional use of interactive video; 

2. All were databased. Reports which contain only anecdotal or subjective 
discussions were not included. 

3. All reports were in the public domain. 

This paper returns to the evaluation literature on IV which meets these three criteria. 
The intent is to examine how the studies published between 1985 and the present 



corroborate, contradict, and expand the conclusions reached as a result of the earlier 
study. 

This paper will be structured as foiiows: The first section will be a descriptive profile 
of the reports; second will be a review of the conclusions; next will follow a discussion 
of the way the newest studies corroborate, contradict, or extend the understanding of 
the earlier analysis; and finally, some general considerations about evaluation and the 
craft of interactive video production and use will be presented. 

1. There are several points which were made in the earlier analysis which are 
reinforced by this study. 

A. The first of these is that general statements about the effectiveness of Interactive 
video are invalid. Individuals who discuss interactive video, not infrequently, are 
prone to make categorically statements about it. For example, they will indicate that 
interactive video is more effective in achieving learning outcomes and other 
methods. Or, they will discuss the ways in which interactive video is effective. It is 
important to understand that there can be considerable variation on a wide range of 
design characteristics under the ailebook of interactive video. This renders any 
kind of general statement as invalid. 

B. This analysis demonstrates that there is more consistency in a results on 
attitude than there is on achievement. This is not surprising given the fact that there 
are, as mentioned above, many differences in the actualities of the instructional 
treatments which are categorized "interactive video. ** It is easier to achieve positive 
data on attitude since many individuals are impressed by the mechanism and 
characteristics of interactive video equipment. 

2. There are some problems in the studies which are reported which bear description. 
A. The first of these is the fact that many of the studies were for a quite brief time 
duration. It is not unusual for studies to be of just a few sessions. Given the 
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attractiveness of the cosmetic features of interactive video, it is particularly important 
that studies involving longer durations be provided when individuals have 
opportunities to acclimate to the technology. 

B. Many of the studies maintain 1) a lovy^ level of description with regard to the kind 
of interactive program design which was provided. This continues to be a problem, 
especially in those instances where there is indication of positive effects. 
3. There are some general issues which the study of these evaluations raises. 

A. It is very Important to have a higher level of common concepts and terminology. 
Efforts to provide a synthesis of the research are hindered by differences in the 
language individuals use. 

B. Formative evaluation continues to be an important need in the design of 
Interactive video. 

C. Another aspect which needs to be considered is the need for more studies 
which look at interactive vid^o in contextual applications. Ultimately, interactive 
video is used in real life situations where it is typically inserted into an organization 
or setting which has its own culture, traditions and customs. 

It is important for us to begin to understand how these factors impinge on the issue of 
the consequence of interactive video. We rarely would begin at the first card and 
proceed sequentially through them. Rather we access cards depending on our 
particular interest and we may select among these cards in any one of a virtually 
infinate number of pattems. What this means is that IHypercard is a nonlinear structure. 
If we are doing an instructional task and which to make use of IHypercard, it is certainly 
possible to devise an instructional program which uses HyperCard in a linear way. The 
way that we often think about instruction has been highly influenced by a book which 
contains a single path to the information. Those who attempt to explicate a particular 
body of knowledge are inclined to see a pathway through the information which is 
deemed to be the appropriate way of treating the subject. If we recognize that in real 
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world learning, then quite frequently we do not learn in a sequential, linear pattern. 
The person who learns car repair from a paren; or friend is unlikely to begin with a 
discussion of the general features of a car and proceed sequentially through the 
various automotive subsystems, as he or she might do if they were provided with formal 
instruction on automotive technology. Rather, what they are more likely to do is to 
plunge into a task they need to perform and continue in this manner, picking up 
techniques an knowledge as they proceed. As I have been involved in the design of 
Instruction using HyperCard, I find myself confronting some biases which I realize are 
mere deep-seated than I would wish them to be. I find that I have to trust the learner 
and must be willing to acknowledge that the learner can select and sequence the 
instruction in ways which are meaningful to him or her which may not be the pathway 
which seems the most desirable to me. Certainly we can recognize that the individual 
who has the understanding of the subject matter does have some broader knowledge 
about the entire sequence. But we probably overstate the issue of pathways. 
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FOR: 


CONTENT- 


EVA. 
TYPE: 


ON IV 
PROGRAM: 


IV COMPARED WITH* 


n 


OF 
TIME 


OUTCOME 
VARIABLES: 


REPORTED 
BENEFITS 


STAT 
TEST? 


Evans. 1989 


Adults 


Cancer 
Treatment 


F 


H 


No comp 


9 


9 


None 


— 


No 


Moore. 1989 


Adults 


Nutrition 
info 


S 


L 


Control 


77 


7 wks 


Food 

purchases 


Yes 


Anal of 
covar 


Bosco, 1988 


Adults 


Health/ 
Safety 


S 


L 


Classroom/videotape 


208 


3 hrs 


a Achievement 

b Attitude 

c Opinion toward 

training 


a Yes 
b Yes 
c Yes 


a. 1 test 
b: No 
c:No 


Cordes, 1988 


College 


Physics 


S 


M 


No comp 


23 Stu. 
7Fac 


Approx. 
1-2 hrs 


a- Student 
Attitude 
b: Teacher 
Attitude 


a: Yes 
b Yes 


a: No 
b No 


Rinkelman, 1988 


College 


Therapeutic 
Communica- 
tion 


S 


L 


Lecture/discusston with 
videotape 


75 


30 mm 


a Achievement 
b* Anxiety 


a. Yes 
b No 


a: Anal, 
of covar. 
b: Anal, 
of covar. 


Hotmeister, 1988 


High School 


Science 


F.S 


L 


Control Group 


15 


9 


Achievement 


Yes 


No 


Branch, 1987 


College 


Physiology 


S 


L 


Control 


8/ 


1 class 
session 


a Achievement 
rest 


a. No 

U O U» ID 

items 


a: Anal, 
of Var. 

h t toct 
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AMOUNT 
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HaiNkins. 1987 


7th, 9th. 11th, 

grade 

students 


Health Ed 


S 


M 


No comp 


2,372 


14 mos 


a Altitude 

u oeM-repuns o' 

behavior 


a Yes 
b Yes 


a: No 
b:No 


Lawrence. 1987 


College 


Reading 
Instruction 


S 


H 


Traditional 


36 


1 class 
session 


Achievornent 
Test 


No 


Anal, of 
Var 


Moainnr 1 QR7 


InHiictru 


Plprtfonir 
Principles 
& Measure- 
ment 


F 


H 




80 


1 lesson 








Mellin. 1987 


Junior high 


Scientific 
Inquiry Skills 


F 


H 


No comp 


116 


2 

sessions 
of 

use/un- 

NpPCIil»*0 

timo 




























Olsen. 1987 


High school 
students 


Chemistry 


F 


H 




132 


appro X 
4 hrs 








Weathers. 1987 


High school 
students 

Q 


Film 


S 


L 


Classroom instruction 


/O 


2 wks 


a Ob|pctive test 
b Vidpo test 


a No 

b Yes 
(control) 

1 f \ 


a Anal, 
of covar 
b Anal, 
of covar. 
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AMOUNT 

PRINCIPAL OF INFO. 

INVESTIQATOR INSTRUCTION EVA. ON IV 

AND DATE: FOR: CONTENT: TYPE: PROGRAM: IV COMPARED WITH: 



AMOUNT 
OF 
TIME: 



OUTCOME 
VARIABLES: 



Pages 



REPORTED STAT 
BENEFITS TEST? 



Mbmm$. 1986 



Grover, 1986 



Kelly, 1986 



LeBrasseur. 1986 



Boen, 1985 



Levenson, 
1985-86 



College 



Adults 



Mildy 

handicapped 
& remedial 
high school 
students 



Teacher Ed 
students 



College 



College 



Basic 

Photograph 



ESC 



Math 



Ed. Psych. 



Study Skills 



Smokeless 
Tobacco 



F.S 



M 



H 



H 



M 



Linear Videotape 



Linear groups 



Traditional Basal Text 



"Traditional Teaching 
Methods" 



1. Individual Video Tape 

2. Group Videotape 
3 Control 



128 



69 



?8 



57 



32 



205 



Approx. 
1 hr. 



90 mm 



10-20 
mm 

lessons 



1 hr 



Approx 
30 mm 



Approx. 

30 mm. 



a: Achievement 
b. Attitutde 



Altitude 



a Achievement 
Test 

b. Time-on-task 

c: Student 
attitudes toward 
math computers 



Attitude 



a Achievement 
b Time to 
complete lesson 



a: Attitude 

b. Achievement 



a: Yes 
b: Yes 



No 

a: Yes 
bYes 
c: No 



Yes 



a Yes 
b:Yes 



a: Yes 
b: Yes 



1 



EVALUATION TYPE: 



FORMATIVE 6 



SUMMATIVE 1 4 



13 



INSTRUCTION FOR: 

Junior High Scliool 

or High School 6 

College 8 

Adults 5 



14 



AMOUNT OF TIME 
OF TREATMENT 



THIRTY MINUTES 3 

ONE-TWO HOURS 4 

THREE HOURS 1 

FOUR HOURS 1 

ONE CLASS SESSION 3 

TWO CLASS SESSIONS 1 

TEN 30 MINUTE SESSIONS 1 

TWO WEEKS 1 

SEVEN WEEKS 1 

FOURTEEN MONTHS 1 

UNKNOWN 2 
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OUTCOME 



ATTITUDE 8 



OTHER 



If; 



TYPE OF VARIABLE IV "WINS" IV DOES NOT "WIN" 



ACHIEVEMENT 



